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ABSTRACT' 

• Mastery Learning and Student Team Learning are t t'wo 
iwideiy used instructional methods designed to confront the problem of 
student diversity in group-paced instruction. This study evaluated 
Mastery Learning, Student Team Learning, and a combination, in 43 
inner-ci*ty math nin^ classes over a full school year. Efesults 
indicated greater^ achievement 6n a standardized test fo£ Team classes 
than non-Team classes;* but no greater achievement in Mastery than 
non-*Mastery classes. Differences in time use" were suggested to 
explain treatment differences in sjtudent achievement; (Author/MP) 
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. Introductory Statement / 

The Center for Social Organization .of Schools has two primary objectives: 
to develop* a .scientific knowledge or how schools affect; their students, 
.and to r "use. this knowledge to develop better school practices and organisa- 
tion. - » ' "** * " ' " . , 

The Center works through five programs to achieve its object ivesv The^ 
Studies in School Desegregati on program applies the basic theories oy 
social orgSnization.of schooi? to study the internal Conditions of 
desegregated schools, the feasibility of alternative desegregation policies, 
and the interrelations of school desegregation with other equity f issues 
such as housing and job desegregation^- The, S chool Organ ization program ^ 
is currently concerned with authority-control Structures, task .structures , 
reward systems, and" peer group processes* in schools.' It' has produced a 
large-scale study of the effect-s of bpen\schools , has developed Student 
Team Learning instructional processes* for. teaching various subjects in 
elementary apd secondary schools/ and has produced a computerized system * . 
for school-wide attendance monitoring* The School ^tPS^ s A,. a IL^^ a y. e . e . r 
Developmen t program is studying transitions from high school to post- 
secondary institutions and the role of schooling' in the development of ^ 
career plans and the actualization of labor market outcomes. The ^udies 
i n Delinquency and School Environments program is examining the inter*- 
"action of school environments, school experiences, and individual character- 
istics in rela!tiQn te in-school and l^ter-lifce delinquency. ^ „ 

iThe Center also supports a Fellowships in Efluca'tion Research program that 
provides opportunities for talented young researchers^) conduct and 

^publish significant research, arrd"to encourage the participation of women*) 
and* "minorities ifi research., on education.. r • /- 

This report, prepared by * the School'OVganization program, ; reports the result 
of a large-scale experimental study*- of 'Mastery Learning and Student Team 
Learning instructional methods. - % 



* Abstract 

&. ' v 

Mastery -Learning and Student' Team Learning are two widely used 

• " * I * i - * 

instructional methods designed to confront the problem of student 

diversity in group-paced instruction. This study evaluated^ Mastery 

>* 

Learning, Student Team Learning, and .a* combination, in 43 inner-city 

* • 

math nine classes over a full school year/ Results indicated greater 
achievement on a standardized t^est for Team clashes than non-Team classes, 
but nc^greater achievement in Mast ery than non-Mastery classes. 
Differences in* time* use were suggested to explain treatment differences 
in jstudent achievement^ * ' * 
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• 1 ■• ■ 

% 1 Introduction-^ * 

i * * 

Over the pkst s.everal; years , there has been growing interest among 
educational researchers in methods that seek to improve group-paced (as ' 

3 

0% 

"opposed to individualized) instruction. The question asked by this 

research is — given that many teache^ teach the same material at .the"- 

• * 

same rate to all their students, how can the effectiveness of this form 

o^ instruction be maximized? Improving group-paced instruction is 

especially important in junior and feenior high schools, where individualiza- 

« 

tion using either homogeneous reading or math groups, programmed instruc- ' 

tion,' or learning stations is rarely seen. In these schools, it is common 

practice* for a single teacher to instruct a class of ^5-35 students who . 

• may be quite, diverse in background, aptitude, and motivation. 

This diversity of student population creates several instructional 

design problems for the group-paced^classrooms. First, instruction must 

be appropriately paced to meet the .different needs of individual students . 
1 . ' . 

1 

A fast instructional pace may leave behind students who are not catching 

m ' \ - ..... i . • 

on, and the cumulative effect of a fast pace may be especially deleterious 

• *» * . . « • 

" in highly sequential subjects .such as mathematics and reading in which 

students who fail to learn early .skijls- have difficulty, learning later., . 

ones*(see Karweit, Note 1). On the other hand, a slow pace mJy hold back 

more Able students and may reduce the interest. of all students. 

Another problem that student diversity creates for group-paced 

instruction is how, to reward students for their efforts. In a heterogeneous 

% * - 

classroom, good grades may be too easily available to some students anfcli too 
inaccessible to others po serve'as powerful motivators t (see Slavin, 1978a)^. 
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•Thfis, ^student diversity poses critical problems for- the' facing oT 

instruction and for the incentive I structure used in the classroom/ 

Three' types of- group-paced instructional methods have been extensively 

researched in .recent years-mastery Learning, Student Team Learning, and 

direct instruction learning 'models . Each deals with the inherent problems 

of group-paced instruction and student diversity in different ways. This . 

' paper describes each of these methods-, reviews the literature related fo 

• its application, and reports the results of a year-long experimental study 

which implemented and evaluated variants/ 6 f these group-paced instructional 

« i 

models . , t •> 

' Mastery Learning .... 
. Mastery Learning is the oldest and probably the most widely used 
systematic alternative to traditional groujp-paced instructional methods. 

9 

■ Individualized methods, such as the Keller Plan, are often also referred 
to- as Mastery Learning, but we are interested here in Mastery Learning as 
a group-paced strategy, following Block and Anderson's (1975) Mastery 

•• Learning in Classroom Instruction . Reduced, to its essentials'; group-paced 
'Mastery Learning procedures involve the following teaching steps (from 
Block and Anderson, 1975, pp. 46-47). ^ ^ 

1. Present the objectives. ""'«',, * 

2. Present the group-based instructional plan. 1 v 

( 

3. ' Rrfesent the group-based instruction. - — v 

I' H * 

4. Administer tfie diagnost lc-progress ^("formative") test. 
, » « « * 

5. identify satisfactory/unsatisfactory progress In student 
learning J (i.e.; compare students' scores against a ' preset, standard , such ^ 
as '80% or 90%. correct* on the formative test)\ * 

6. Certify tho^e students 'whose test performance is sat isfactpry* 
-(i.e., meets the preset- standard) 1 . 

i * 

* « 

r 9 



7. "Correct" .(reteach) these students' whose performance is not 
satisfactory. ' + K • * ' 

8. Monitor the ef f ectiveness of . the correction phase (i,.e. , assess # 

' ^ * \ " 

students on a "summatiye" test). . s 

9. " Certify those students whose perfcrrmance 'is now satisfactory 
(i.e., "meets the^preset^standard on. the, summative "test") . 

Mastery Learning -thus confronts th$ problem of student diversity by 
providing additional corrective instruction to students wl^o do' not achieve 
a criterion scoije, "or mastery, on a test tied to the- unit objectives. 
Instead of holding time constant and letting learning vary a's a consequence, 
of individual differences, Mastery Learning holds learning to mastery 
constant, and allocates additional time \o ^Uow^toost all students to 

meet thaj: criterion. While students who did not achieve mastery on the 

' ' ' ' I 
formative .test receive their - correftive instruction, students who did 

achieve- mastery >work on parallel enrichment activities that do not s advance 
J . 

them on the skills the class is studying. ' * . 

Mastery Learning confronts the incentive^ "problems of group-pacec 

instruction (at least fo* low achievers) by making it possible for alt 

stfidWTTa "receive a grade of "A" or H B" if they achieve n&stery ,„ regardless 

of how. long it took them to-do so. - By thus allowing students enough $ime 

^ - ' - * _. 

to master a topic, academic success is theoretically within the reach of 
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every student. ? ^\ 

- Student Team Learning m • ' ^ ^ 

A. quite different approach to the problem of group-pS^p instruction 
^Ls represented by Stuc^ant Team Learning (Slayin, 1980a), In« Student Team 
Learning methods, students* are assigned to- four- or five-member teams that " 
are hetetogeneous *n student perfprmance levels, sex, and race or ethnicity. 
There are several related Student Team Learning methods, but. the simplest 
9 .• is Stiident Teams-Achievement Diyisions , 'or STAD (Slavin, 1978b). In 
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classroom •use, STAD involves the following steps: 

' . . V. * v > 
1 The teacher presents the lesion (using lecture-discussion methods). 

' • r " • ' * \ 

% 2.- Students work 'in teams ^worksheets to study the' lesson. 

"-11- ' 4 

• 3. Students take a quiz on the lesson. /- 

4, Quiz scores are compared to'students 1 past averages tcy compute^ 
improvement scores. ( w ' 

5. Team scores are 'fprmed" from improvement scores, "^nd highest- 

scoring teams are recognized in a class newsletter. , 
•< . - * 

SlAD confronts the instructional probiem of* strfdent diversity in . 

grqup-Jaced instruction by aJ.lowing_students to«work on their worksheets 

in heterogeneous learning teams. Students use th\ team study time both ^ 

to learn the. materials themselves and to make sure that their teammates 

have done so. While tutor-tutee roles- are not assigned, the fact that the 

* * * 

team members are heterogeneous in performance levels means that students 
who. do not understand the concent b<*Lng taught are likely to be able to 
learn the concepts -from their peers. STAD units typically take about the 
sairfc amount of clasp time as do units in traditionally structured classes, 
-so STa! changes how instruction is delivered and studied rather tfian how 
time is allocated for students to learn. 

STAD confronts the incentive problems of group-paced instruction 
by-rewarding Improvement rath'er-than absolure_-JLeyll_of^ performance . This ^ 
System puts .success and failure within the reach of every student, in 
contrast to the traditional grading system in which some students'are ^ - 
much more likely to succeed than others (see Sla'vin, 1978a).. The team 
score is designed to motivat^students to help one another and .to encourage 
one another to do wen, and The* improvemfent^sc'ore system allows any 
"student to contribute as much as any other to' the team score. 



D irect Instruction Components of Mastery and SXudent Team Learning ) ^ 
— ^ s ' , " - —————— 

Another approach tb designing a group-paced cla^s^opm is«a*'set of . 

■. . % • * - v ' ■ : - • ♦ • * 

'principles collectively subsumed under the title' ''direct instruction" ^ 

* • ' ■ " \ ' *V - ' 

(Ro^enshine and Berliner, 1977). The assumptions behind direct instruction 

are' quite different from those behind* Mastery Learning and Student Team 

Learning'. Mastery Learning and Student" Team Learning explicitly recognize f 

studenl diversity as a probfem to be solved in group-paced instruction; 

> ' • ' " * c ' ' 

this is th£ central focus of Mastery Learning and to a lesser ^extent ot - 
Student Team Learning. . Ttfe assumption .guidir\£ direct -instruction methods # 
is that group-paced .instruction should be made more^fef ficient, and that 
solutions to 'the general problems of group-paced instruction Ire In well- J 
established techniques, noV in entirely new techniques such as Mastery t 
Learning and .Student -Team Learning. Direct instructional methods or^ \ 
prescriptions yary. widely, but „agree bn^ the centrality of such features 
as^clear focus on instructional objectives, frequent assessment of student 
progress,, high tirae-on-task, and rapid pace (see", for example, Oopd ^nd 

% Grouws, 1979).. • • ^ \ 

Note thafwith the exception of rapid pace, the other features of 
direct instructional models appear in both ^Mastery .Learning *tuf Student . . 
/Team Learning. .These methods also 'emphasize clqar focus on instructional*' 

^ , 'objectives, frequent assessment (ciujizzea) , and s high -time-on~task . V fc 

_ _%„ • _ * i ' * I * • : 

Matery Learning" inherently invqlvesLa Slower pa£e, because it allocates 

class- time to corrective instruction for students who. heed it. Student - ^ 
v 

Team Learning does emphasize a rapid 'pace, but the varied activities 
' involved in Student Team Learning typi£«ally require an overall instructional 
pace like that of the traditional classroom. However* it -is still possible 
to see Mastery Leatning and Student Team Learning as variations 'in * / 
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efficiency-oriented, objective-based, direct instruction. 

" Given that Mastery Learning an! Student Team Learning contain much 
of the instructional efficiency advocated by adherents of the direct 
instruction movements it may bei possible that i'f and when these methods 
are successful ,in increasing student achievement, they -are successful 
because they incorporate and operationalize these elements, not because 
of their unique features (mastery 'criteria and corrective instruction for 
•Mastery Learning; heterogeneous teams' and improvement scores for Student 
Team Learning) . 
Research 

The .extent to which Mastery Learning significantly improves student 
achievement in elementary and secondary • school is not completely clear. 
Although the* effects of Mastery Learning on student achievement have been 
assessed in ddzens studies, few of these provide a fair test of Mastery 
.Learning vs. traditional methods over a significant period. For example, 
sotfe studies (e.g., Anderson,. 1973, Note 2; Block, 1972, 1973; Fiel and 
Okely,.-1974) took- place pver periods of one week or less. Many (e.g. 1 , 
' Block,, 1972; 1973; Fiel and jOkey, 1974; Glasnapp, Poggio, and Ory, Note 3; 

* iff?* * f 

Hymel and Gaines, Note 4-; Jones ,||ote 5; Went ling, 1973) gave students 
corrective instruction, outside of regular, elass time with'cmt providing * 
any additional instruction fo.r the control groups. ■> In one study thai 
measured- this extra time gentling, 1973), it was foutfd that the Mastery 
Learning classes recfci-ved^ total of 50% more instructional time than did 
control classes. A few studies^(e.g. , .Caponigri, Matheis, and Schumann, 
Note 6) have even used grades as dependent variable's, which, is not ' 
legitimate, because g^bdes ire increased in Mastery Learning as part of 
the treatment < 



Isome evaluative research on Mastery Learning does not contain these* 
flaws (see, for example, Okey v 1974/1977; Hecht, Note 7). Hpwever,, these . % 
studies share a more subtle problem.' In each, a specific unit of study' is 

given to Mastery 'Learning grdup(s) and control group(s). \ The different ^ 

> 

'classes are held to the same schedule. This seems unbiased^ but many 
studies (e.g., Wentling, 1973) show that . traditional instryction takes less ^ 
time to cover a unit than does Mastery Learning. If this is the case, 
holding both groups to the same schedule may artificially deprive the tra- 

ditional control group of its t advantage,- especially when (as in these 

/ « *■ . 

studies) a test based on the objectives taught in the Mastery clasees was 
used instead of a standardized test^ s^Xhat any additional material taught 
in the traditional classes could not influence the final test score. Also, 
these studies are of short duration^ ThJIongest (Hecht, Note 7) covered 
three two-week units, while the Okey U974, 1977) interventions were 
implemented for a tot* of only two weeks. 

Two Mastery Learning studies in mathematics did allow the experimental 
and control groups to go at their .own rates and* evaluated *the program over^ # 
a long period. Kersh (Note 8) compared Mastery Learning to a control 
treatment in f if th . grade, mathematics classrooms f6r sixteen weeks. No 
differences on any of three achievement tests (including two standardized 
test scales) we/e found. Similarly, Anderson^ Scott , and Hutlock (Notjp 9) 
compared Mastery Learning to a control treatment in grades 1-6 for a full 
year. Standardized test results indicated that Mastery classes significantly 
exceeded control classes on one of three subscales at grade 1, and on two 
of three subscales at grade 3. However, Non-Mastgry classes significantly 
exceeded Mastery classes on al£ three subscales at jg^de 6. Results con- 
♦sistently favored the Mastery classes on a test ,'composed of objectives ' 
taken directly from the Mastery curriculum; the I authors admit that these. 

14 
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comparisons are more "content valid" for the Mastery groups 'than for the / 
control -groups, A retention tes^t given three months after the end of the 
interventions. was also based mostly 01^ the objectives pursued^ in the 
Mastery classes, 'Thus, on tests that were; not biased toward the s Mastery 
classes, these linger' studies that allowed The control gtoups to go at 
t*herir» own *p ace did sot show advantages for Mastery Learning. 

Although it is possible to find fault with one or another Mastery 

* * 
'Learning study, the fact that many studies done in many different settings 

^have -found positive effect's, of Mastery Learning on student achievement 
cannot he completely discounted. There is still a need for studies of 
Mastery Learning that aJ.low the Mastery and traditional groups to go at 

1 the'ir own" rates, so that coverage as well as degree of mastery are both, 
allowed to vary."' There is also a need to discover whether any effects of 

' Mastery Learning are due to the use of Mastery criteria and corrective 
instruction, or due ,to the. emphasis on clear objectives and frequent 

* • | 

assessment that are characteristic. of other group-paced models^ such as , 
Studentu Team -Learning and Direct Instruction, 

Documentation of effects of Student Team Learning on student achieve- 
ment is somewhat more straightforward, although there are still a few 
.problems. Nineteen of the twenty-two field experiments evaluating Student 
.^Team Learning methods (STAD, TGT, and Jigsaw II) have founa significantly 
positive, effects on student achievement (see Slavin, in preqs) . In all. 
-the Student Team Learning studies, experimental and control 'groups are 
*-given the same opportunity , to learn a specified set of objectives, without 
any additional time or resources (other than teacher training) given to 
the experimental .groups. Almost all' studies of Student Team Learning 

* * * ' 

involve time periods -of at least six weeks, an'd all use standardized 
. and/or. curriculum-specific teats as dependent variables. In most studies 



of Student Team Learning, the "control" group used a* structured method 
< c^alle^' "focuse<J/ instruction," in which the teacher/ presents a lesson, 
students wcftrk individually on worksheets, and then students take a quiz. 
Focused instruction thus contains the direct instructional components 
(e.<g., clear focus on instructional objectives, frequent assessment) ^ 
contained in Student Team Learning. Therefore, in such .studies (e. g. , 
Allen and Van Sickle, Note 10; Madden and Slavin, Note 11; Slavin, Note 
12, 1981; Slavin and Oickle, 1981), the treatment effects on student 
achievement are clearly due to the use of the teams and the improvement 
scores. Focused instruction itsjelf has been found to -significantly 
improve student achievement"; (Slavin, 1980b; Beady, Slavin and F^nnessey, 
1981), and when Student Team Learning is compared to completely" untreated 

<?bntrol groups (not using fc?cul&d instruction) achievement effects -are* also 

» . * j • 

positive (e.g., Slavin and KarUit, 1981; Sl'avin, 1980bj also see DeVries- 
and Slavin, 1978). One? important' problem, not addressed until this paper, 
4s that none of the STL 'studies has lasted longer than a semester. It is 
important to find , out if team motivation, a 'critical element of the treat- 
ment, diminishes with a longer period of time.- Also, studies of Student 
Team Learning do not always find significantly positive effects on student 

achievement; a few studies '(e.g., Slavin, 1978c, 1979) find no significant 

\ 

differences in achievement, although th$re is always a* trend "favoring the 
Student Team Learning group. 

i. 

* St'udy Design 

'The present study was designed to investigate ttfe effects^f Student 

Team Learning (STAD), Mastery, a combination of teams and Mastery, focused 

instruction, and an untreated control group on student achievement. This 
r . ( * . 

study compares these five treatments in a common design that allows 
'instructional pace to var.y but clearly specifies the instructional universe 

" 16 
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that teachers are responsible for by providing all classes with the same . ( 

A 

book and .associated objectives. _ The *tudy took p x lac^ in general mathematics 
(Math 9) classes in- inner-city Philadelphia junior/and senior high schools, , 
and the teachers in each condition were, trained hfy a 'school district staff 
development team experienced in all the methods/ The research staff, 
except, for behavioral observers who werel not /wave of the purpose of the 
study, had minimal involvement with progran/ implementation after the initial 
training. / This strategy avoided the possibility that extra attention. or 
assistance of the researchers could afficU^fe' results.^ Thus, the ! 
treatments were implemented with minimal interventibn, involvement, or 
supervision of the research staff. The experimental procedures were used 
over the entire school year to reduce the possibility that treatment effects 
'would be»due to novelty or to short-term motivation, and to allow all 
teachers an equal chance to cover the entire book on which. the curriculum 
wa,s based. 

. Teachers volunteered for the study and were randomly assigned to one 
of the five treatments \y the research staff. Teache'rs could carry o„ut 
their assigned treatment io.more tfian one class if they so chose. 

The experimental design allows for twd sets of comparisons. One, a 
2x2 factorial design, evaluates Mastery Learning and Teams as factors, % 
• with all treatments' sharing the same curriculum materials and basic 
schedule (teaching-worksheet-quiz). This comparison permits assessment of 
the efh*cts* of Teams and Mastery Learning on achievement net of their focus 
on clear objectives and frequent assessment. The second set of comparisons 
involves contrasting each treatment with untreated control classes ..These 
comparisons evaluate each method as a package, rather than as a set of - 
components. • 



Methods ♦ r , 1 ' > <■ 

• * * *_ * 

•f t 

The- sample consisted of 1„487 ninth grade general mathematics students 
in 16 juni^senior high schools in inner-city Philadelphia, Of tHese 1 
students,' 7^6 had usable pre- and post-test achievement data. This longi- 
tudinal sample is the basis of the analysis reported in this paper. Sample 
loss came about because of student absenteeism and mobility within the 
system. In addition, seven classes were deleted from the sample because 



few6r than five students in the class had usable pr^ and post-tests. 
Thtt$»the final sample consisted of 49 classrooms: 

Although the sample loss is appreciable, it was roughly the samfc across 
all five treatments, falling in 7 the range from 48 to 53 percent." Conse- 
quent^ly, whatever factojrs lead to sample loss were probably equal across 
all treatments. - We/fiote also that a comparison of the achievement data of 
the cross-sectionajl samples with the longitudinal samgji reveals the usual 
pattern of higher scores for the longitudinal than the cross-sectional 
* sample. 

5 ♦ . * 

Measures 

shortened version of the Mathematics Computations and* Concepts and' 

t 

Application sub'scales of the' Comprehensive Test oi Basic Skills (CTBS),. 
Level 2 Form' S, and a curriculum specific test are the achievement measures 
used in this analysis. Every third item was taken from>the CTBS in order 
to achieve a 30 item test which could be taken in one class period. The 

• * » 

.curriculum specific test was derived from items on the twenty-six work- 
sheets. The raw number correct wad used as the achievement measure for 

'both the, CTBS and the subject specif ic analyses . 
Design and Treatments ' . 

* The experimental design was' a, 2 x 2 factorial design, with Mastery 



Learning and Teams as factors, plus an external untreated control group. - 
The conditions are referred to as Mastery, Mastery and Teams, Teams, v • 
and focused instruction. These four treatments h/4 both the- curriculum 
materials ,and the schedule of instruction in common. - 
Curriculum 

— « 
All four experimental treatments used the same curriculum materials. 

The curriculum consisted of 26 sets of worksheets and quizzes'. The work- 

sheets and quizzes. were adapted f rom Vlathematica for Today (Tobin, 1975), 

a Math 9 text that uses re^l-life problems to teach basic mathematical 

«■» 

operations to low achieving students. The two' Mastery treatments alsc# 

* % * % ' 1 ' 1 u~> 

received sets Of enrichment activities, to be used, by those students! who 

had attained the, mas,tery. criterion on the formative test. These enrich- 
ment activities paralleled th£ worksheets and quizzes, 'but were made more • 
difficult. The untreated control group received copies of the Tobin text 
but no|: the worksheets and quizzes. . 
Focused^Sch edule of Instruction • ^ * £ 

All' treatment's used % a similat schedule of instruction that consisted 
of teacher le^ture^ worksheet work, and 'quizzes. ^Jhis cycle usually took* 
about one week to complete. 

Treatments ( ^ 

" Mastery (11 classes^ 6 teachers). In th£ Mastery classes, the teach- 

« *- 4* A 

ing ol tfie units followed a prescribed sequence of. teaching, individual # - 

worksheet work, formative quiz., corrective instruction, and summative ,quiz, 

*"• '** » 

The formative quiz was -used to determine if -students had achieved the" 80% 

mastery criterion. Those who had not achieved mastery received corrective* 

t ^ 
instruction, followed by a^summative quiz. Those students ™ho attained 80% 

or better on the formative quiz wftre provided enrichment activities per- 
taining to the same units. 



. ' Student Team Learning ' (8 'classes , 6 teachers). -In the team classes, 
the students followed a sequence of teaching, team study of the unit, and 
then ^ quiz on tfre unit. The quiz scores were^compared to students 1 past 
averages, and- their improvement scores were spiraned to 'form teato scores/ 
The highest scoring teams were recognized in a class newsletter. This ^ 

procedure was identical to Student Team Achievement f Divisi 1 oi>s as designed 

. ' ) " ' * ' * ^ ; • 

by Sl'avin (1980c). ... , ' . 

Teams and Mastery (8 classes, 6 teachers). These classes^followed a 

sequence which combined elements of the Team treatment and Mastery treat- 

m^nt -described above. In the Teams and Mastery treatment, the classes were 

taught using this sequence: teaching, ^team study jr forrhafcive quiz, correc- 

? y • • ' * 

tiye instruction within teams, and summative quiz. Students who did not 

d — 

achieve the 80% mastery criterion on the formative test received corrective 
instruction within their teams. After corrective instruction, they took th 
summative quiz, and the teams' summative quiz scores were tormed into team 
scores as .in the Team treatments ' * . 

Focused Instruction (7 classes, 4 teachers). This treatment aerved 
as the control group *in the factorial design. ; Classes use<*a schedule o»f 
instruction as follows: teaching, individual worksheet work, and quiz. 
*This treatment thus differed froM the Mastery treatment in that no correc- 
tive instruction or summative quiz was given. It differed from the T£am 
treatment in that students worked individually and did not receive t;eam , 
recognition. t 

Untreated Control (15 classes, 10 teachers). Besides the four ' 

experimental conditions, an untreated control group was included for 

comparison purposes. This group received the same textbook on which the 

worksheets and quizzes wgre based, but' did not receive the worksheets and 

quizzes. This group thus received instruction in the same material, but 

• » 
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their teachers ysed their normal instructional methods ? 

• Results 
" • . Table ^contaftis fhe results of the analyses" of the standardized 
and subiect curriculum specific achievement, tests. In the^e analyses, 
the standardized pre-test was used as a covariat£» / ^ 



Xable 1. About Here 



The top panel of ' Table 1 .-provides the means 'and standard deviations for 
the pre- and post-tests. Examining the pre-test values for the'csmtrol - 
and experimental groups, it' is apparent that the control -group scored 
appreciably lower on^the pre-test. Comparing the pre-test control group, 
-mean to the experimental 1 treatment means, we found that the control group 

. — 4 , 

was significantly lower on the .prie-'test than^the experimental groups 

J* I'm. « 

, (F 11.56 p C.OOl). Thus, it appears that the control group departed 

\ r c 

substantially f^rom what wQuld be expected by' random assignment. We could 
not locate any particular reason for this breakdown in randomization. 

Despite this difficulty we dq use the "c6ntrol group in the following 

* . ' - . ; 
analyses, cautiously interpreting the results in light -of theg: problems 

• in randomization. * i » • • 

<- ' ^ * 

2X2 Comparisons • . • . * " . 

J ' ; These analyses involve only the four experimental condition?-. We 
carry out an' analysis of ' covariance, controlling for the standardized 
pre-test, to determine* the importance of the Mastery factor, the Team 

^ factor, and their interaction in explaining the post-te'st scores. The 

difficulty in randomisation does not influence the^e results, ^ as no \ • 

V' 

statistically significant pre-test differences were found among, the 

» % » 

"treatment groups in the 2 x V design. The middle * panel of Table 1 provitf 
* . > • ' 

the F values'and relevant p's for the 2 x 2 comparisons. The team factor 



classes had significantly higher standardised post-tes^s, /net of pre-tests, 

thao^did non-Team „ classes (F 9^56, p <.01). The Mastery .factor and 

■* " . - • « 

' y * > 

the-4nteractioh term were not significant for, t^ie standardized>tests . The, 
2x2 comparisons involving the "curriculum specific tes£ Bid not indic^te^ 
any 'significant differences. 
Treatment vs\ Control Comparisons' 

* » * v A 

V p * W - 

In these analyses-, we compa'red each of the four exjjerimej^tal conditions 
(separately) t/ith the untreated control group, In, the discussion, 4 we Keep ( 
in mind the difficulties in randomization^ discussed earlier.-' For*the 
standardized test, 'both tl^ Mastery group and the fpcused instruction , 
group differ significantly from the coritrol group (F = 9*23', -p < .01 for 
Mastery; F = 5.95, p <.05 for focuse'd instruction) / In both cases, the 

: . ' *" ' * •- ' 

experimental conditions performed worse on the post-test, controlling on ^ 



their initial score, than'did the control group. The poor performance ■ 
of the Mastery group in comparison to the control group 'is seen again«on 
the curriculum-specific test (F = 4.51, p<-.05): On this test,, .however, 



the focused Instruction group "did not differ from "the cpntr»$. group. No 
significant differences wer.e found for the Mastery* ^nd Teams or. the T£#ns 
treatments/ Again, given the apparent difficulties in randomization-, these 
results must be Interpreted tentatively, as we cannot determine the extent 
to "which these differences aro'se due to treatrfffent^r due to uncontrolled 

* -" - . • ■ , 

factors * , * ✓ „ . , . • * j 

piscussion * „ * . 

This, study evaluated the, achievement effects of a group-pjacgd Mastery m 

' . ' ' ' * * ' V 

Learning model, Student Team Learning,.\a combinarton of the*, two, and a - « 

>•"*"* ^ ^ 

Fodused Instruction model/ in a year-long implementation dn math tiine classes 

^ * - 1 % 

in inner-city Philadelphia. The factorial comparisons indicated 'that 



classes that received the team treatment had significantly higher achieve- 
«'.>.' • " 

ment on the' standardized test, net of the pre-test score. No differences 

*. I 6 \ 

were found in the factorial comparisons for the subject-specific test. 

* , . « r 

r 

The comparisons with the untreated control grpup were made problematic 
due to significantly lower pre-test scores in the control group despite- 
random assignment. The negative results' for Mastery Learning and focused 
'instruction and the lack of significantly riositive results for Student 

; • * . . pO . • 

Teanft^rning on both the standardized ^and "subject-specif ic test must 
/therefore be interpreted cautiously.. It is impossible to determine the > m 
extent to wl\ich these' .findings are due to the 'trea.tmen % t or due to pre- 
j existing uncontrolled factors. 

The lack of an^Ppositive. evidence supporting Mastery Learhing in 
* either the *2 x 2 design or. the treatment-control comparisons was not 

^xpected,. * Given the widespread belief in 'the efficacy bf-Mastfcry Learning 
for this type of student population, understanding in greater detail the 
reasons for the lack of effectiveness seems crieical. We explore^ twc) 
s -additional hypotheses which could account for the lack of positive effects 
•\ of Mastery Learning. .One explanation involves, the effect ^of a different 

o 

VPace of instruction. A second explanation involves the effect of treat- 

' V * • . 

ment-by-ability interaction for the Mastery ^group. % — 

Pacing Effects ** 

' A basic tenet |>f Mastery Learning is that most students can learn if 

^ they are given enough time* to acquire the necessary skills . The uneven 

distribution of *,learn:£ng, acqprdiAig to this "reasoning, results from students 

not living appropriate amourjts'of timfe for learning. . As we pointed out 

4 in the review of Mastery Learning, many" evaluations which have found 

positive. effects for Mastery Learning have provided additional time. Thus, 
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it is plausible that Mastery Learning may require significantly more time* . 

to be successfully implemented. In our study, all treatments wejre given V 

- J • . i ~" ^ 

the same amount of time for mathematics instruction. Mastery Learning 

* * / * * 

"maykave been successful at what it covered but, because it could requirfe - 
additional t^ime, may have pimply 'covered less material. If this^were 
ttue, the Mastery treatment should have performed better on the test items 
on th/'early units that all classes were equally likely to Jiave covered 
than on items from later units, which the Mastery classes may not have 
studied. To test this hypothesis, we divided the subject-specific test 
into jthree portions; corresponding to the time of year in which the items 4 
were: taught/ We then carried our separate analyses for these (three tests 
to determine if the Mastery condition outperformed the other conditions 
on items covered at the beginning of the year. We did not find any ? , 
evidence of differential achievement on any of these subtests. 

A more direct way to examine whether there are significant differences 
in pace Cand therefore coverage) is to examine tefcher logs vindicating 
the number of days s^nt on- apecrf ic units. These logs provide only t \ 

* n ; 

suggestive evidence, .as they were not kept systematically by all teachers 
included in the achievement analysis'-* Comparing' the log data for those 
who did complete them, we do not find that the Mastery treatment actually 
used, on average, substantially more* time per-unit than did the Mastery 
and Teams? or the' Student Team Learning treatment. However, £he Mastery 
groups spent much more time taking^ tests than*did" the non-Mastery groups / 
(26% of their instructional days vs. only 18% of instructional d^y^ in 
the^non^scery^^sgg^.'-^us, ttffe, Mastery classes covered units at 
about the same pace 4 as the team classes, but they devoted less time to • 
actual instruction. This difference in instructional ' time cbuld, of 



^ - * • 
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course explain at least part of the failure of the MasTtery treatment, to 
increase student achievement* l 

Ability X treatment Effects 

Another explanation for tfie lack of positive effects for^Mastery 
Lejrning was the possibility that Mastery Learning^nay be differentially 
effective for some students/ particularly lower ability* students. Such 
an- effect weuld be consistent with the proposed uses of Mastery Learning 
in mahy situations where students are performing poorly. To see if this 
were true, we entered a treatment-by-ability interaction term and repeated 
the analyses reported in Table 1. These additional analyses" indicated 
that there was not an ability x treatment interaction for the 'Mastery 

,/cpndition. However, we did find a significant ability x^freatment inter- 
action for the Student Team Learning treatment, indicating the positive 
effect of STL for students of low ability (F - 4 .35, '£ < + 

It is .possible that implementation of .the Mastery- Learning treatments 

was less than optimal. - Ejven the rudiments of Mastery instruction—testing 

* - 

and corrective inst*4ekxiitzwere difficult to implement given ,the high .1 

absenteeism, high mobility and very low achievement of this^ population. « 

A' — J 

Yet it is ^precisely this .type of population for which Mastery Learning is 
seen as nfost applicable. Also, because- this year-long implementation- did 
not have a high' involvement of. the N research staff in the da?-to-ddy 
activities of c the project, it seems to provide a fair assessment of how 
Mastery Learning would have been implemented under normal Conditions in 
urban schools. In fact, the district training staff which trained the 
experimental teachers used esstKUally the same procedures ■ it has used to 
train hundreds of Philadelphia teachers in Mastery Learning methods, and 
did visit classes seve'ral times over the course of the study to be sure • 



that teachers were implementing their treatments. 

/ ■ • \ * \ v - 

4 The findings of greater achievement on the part of ^ the Team treat- 
ments is consistent with earlier research on Student Team Learning methods 



its 



\ 



(Slavin, 1980a; Slavin,/ in press). This study is significant in the 

m I * > ^ 

research on*Student Team Learning for ttoee* reasons. , First, it isr-the ^ 

7 

only evaluation of tfi^se meth.ods which hars taken place over a full ) 
academic year. The fa6t that signficant effects were found for. this 

• . ■ * ; : ■ - * 

period of time i^s important^ as it i^resses the general applicability 
of these ^methods as^ a, primary instructional modern the classroom. 

Secondly, the study is important because* it found that ttfe addition of 

# » • - 

corrective instruction and summative quizzes did not enhance the' 

. effectiveness of the team learning approach., Third," this .study provided 

additional evidfen&e that Student Team Learning is particularly effective- 

with low achievers. TPreviou^.pre-test by treatment interactions, in flfie . 

same direction have been found for STAD by Slavin*(Note 12) and Slavin 

and Oickle (1981) . 

The conclusions. of k this study must be cautiously generalized. The* 

... N ' . . -A 

students were very low achieving, inner-city students. There were severe 
problems with sample attrition due to high absenteeism, high mobility , *atfd 
class changes within schools. Nonetheless, these .conditions seem to be 
representative of urban school situations, and not defects of th^.study 
design; Similarly, the study was designed to involve a minimum ^amount of % 

y hand -holding flom the researchers in an. attempt to provide^an. evaluation- 

t . ' s 
of a project und^r conditions similar to what the schools themselves would 

experience outside of research. Thus, we see these results* as applicable 

to many.of'^e lower class, urban schbols in which both Mastery Learning 

an$ Student Team Learning are often used, . f 
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Table 1: Acafdemic Achievement Results 



1 

Treatment Means anjl Standard Deviations 

* ■ 
Mastery an^i 



Test 


Mastery 
N=156 


Teams . 
N=125. • 


Teams 
* N=135 


Focus 
- N=138 


Control * 
N=182 


Pretest 
CTBS % 


X4.6 
(5,5) 


* 14.3 
(4.7) 


15.0 
(6.2) 


14:0 
(4.5) 


13.3 5 
. (6.0)" 


< 

Posttest 
CTBS 


16.1 

(5,9) 


17.1, - : 
(5.2) 


17.6 
" (6.4) 


15.9 
'(5.6) , 


16.6 
(6.8) 


Posttest 
CRT 


8.1 ' 
^5.7) 


9.9 
(5:2) 


•0 

9.8. 
(6.3) 


9.7 
. C4.7) 


8.9. 

(6i0) 



CTBS 
CRT 



F Values for 2X2 Factorial Comparison 



Mastery X Team 



Team. 



.10 9.56* 

(d.f .=1,549) * • (d.f. =1,550) 

2.Q7 • 1.05 

(d.f .=1,549) (d.ft-1,550) 



Mastery 



.14 

(<f.f .=1,550) 
.96 

(d.f .=1,550) 



til 

F Values for treatment control comparisons 

Mastery & • Teams Focus. 
• Mastery vs Teams vs vs vs 

Control Control Control . Control 

r— 7<= ■ ' * i 

\ 

CTBS * 9.23** . .281 .235 ■} ' 5.95* 

■ (d.f .=1,335)' (d.f. =1,304) (d.f. =1314) ' (d.f. =1,317) 

CRT, • 4.51* .003 .156 1 - . ' .004 

(d.f, =1,294) (d.f .=1,271). (d.f .=1,271). (d.f. =1,276) 



* P <.05 
** P <.01 



a These comparisons should be interpreted.^th cauticjrf', as there were 

statistically significant differences between the control, group and- th 
experimental treatments. « 

*■ ■ ' \ ■ ' ' 
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